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(54) Method and apparatus for image scaling 

(57) In a storage arrangement for storing data of an 
input image so that an image formed by enlarging the 
input image can be immediately obtained, an input im- 
age is sequentially stored in an input image memory (2) 
with addresses designated by horizontal and vertical ad- 
dresses corresponding to positions of pixels in the ver- 
tical and horizontal directions, respectively. After pixels 
of the input image necessary for forming a pixel-multi- 



plied image, which is an image formed of a number of 
pixels greater than the number of pixels forming the in- 
put image, have been stored in the input image memory 
(2), these pixels are read to a pixel-multiplied image 
forming circuit (3) and are used to form pixels of the pix- 
el-multiplied image. This pixel-multiplied image is stored 
in a pixel-multiplied image memory (4) with addresses 
designated by the horizontal and vertical addresses. 
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Description 

10001] T*h^r^W«l^-^^ rtM ^ M ^^ 
Ld a storage method suitable, .or example for use edging , ' mQst basjc or f|rst layer jmage 

20 Frw.-rnsrs assess irsssrssK 

PIP* 

S^pSSS S implementation ot the Invention described hereinbelow seek. ^ example Jo provide a 
storage apparatus and a storage method for storing data of an image so that the ,mage can be m ™ 6 ^\ B ™^*° n 
[0010] Mention will now be further described, by way of illustrative and non-limiting example, w.th reference to 
the accompanying drawings, in which: 

Fig. 1 is a block diagram showing the configuration of an embodiment of a storage apparatus to which the present 

invention has been applied; . Rn 

Fig 2 is a diagram showing an input image input to the storage apparatus shown ,n Fig^ 1, 
Fig. 3 is a diagram for explaining processing in the pixel-multiplied image formmg crcu.t 3 shown in F.g. 1 , 
Fiq 4 is a diagram showing a pixel-multiplied image; ..„„,. 
Fig 5 is a block diagram showing a first detailed arrangement for the storage apparatus shown , ,n F g 1. 
Fiq S is a block diagram showing a second detailed arrangement for the storage apparatus shown ,n Rg_ V 
Fig 7 is a block diagram showing a detailed arrangement lor the pixel-multiplied .rnage form.ng crcurt 3 shown ,n 

Pig. B is a diagram for explaining processing in the classification block forming circuit 41 and the predicted value 
so calculation block forming circuit 42 shown in Fig. 7; 

Fig 9 is a diagram for explaining classification processing; 

% ;? : asus^ssssss. - — ~ — —™ — . - — - 

prediction coefficients. 

55 [0011] Fig. 1 shows the configuration of an embodiment of a storage apparatus to which the present invention has 
[o e oT 2 ] PP ™s storage apparatus is formed of, for example, a complementary metal oxide semiconductor (CMOS) in 
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addresses and the group of vertical addresses .s t ^ n * e J^ | ^S'addre.se. supplied to it according 
,o [001 S] The address supply circuit 1 ,s arranged to P rTO9S ^^™^ ° , SeKnultWed image memory 4. The 
0 one's need and to supply addresses to an input .mage memory ^7 ™^ J^, signal and a 
address supply circuit 1 is also supplied with a clock <"* *"^^ u "^ c * arranged to supply addresses 
selects flag as wel, as horizontal and ve rt ica. = 

£7 'SSSJX- is a signa, for — J - J^^W^^ 2 

Image data to the storage apparatus, and the ^0^^ memory 4. 

tion flag is ignored at the time of writing. arrannP ri to store with addresses from the address supply 

[001 7] The input image memory 2 (first storage means) k ar anged to ^ RMW circuit 

circuit 1. image data supplied from a read modrty wnte c.rcurt J^^mSfnputtoL storage apparatus 

5 the image data stored with the addresses. The ,nput -mage « 2 esan .mage npu 9 g ^ 

(referred to as original image as occasion demands) w.thout chang.ng me , mage. Ateo the ,np g V 
store at least one frame o, an original, image, ,e image data o, 512 X 51 p*el . « .h ^ ^ ^ ^ ^ 
cells forming the input image memory 2 have at least a data lengm «*™P h represented 
assigned to each of p.xels forming an original .mage. That .s ,f ^^^J^J^Sita length of eight bits, 
by. for example, eight bits, the memory ce.ls tarn* I the, ^ »Q* ^^ST^i^^W ima^e from 
[0018] A pixel-multiplied image form.ng crcurt 3 (fomung means) P * ixel . mult jp|i e d 

the original image S^^SK e.g., a p£ A, shown in 

SJS SSiSSS S; S circu,, 3 newly'forms a ^^.^1^ 
Allocated adjacently on the right-hand side of the observed ^^^M^mZ S observed pbce. 
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image forming circuit 3. memorv 2 image data supplied as an original data 

fn synchronization with the clock and based on the R/W signal and the selection flag. 
SSf Fig. 5 shows a first detai.c I arran ger^tfor the storage ^ ^ 

[Sis SSS ^rJ-^S^^*. —paratus as shown in Fig. 2. and 
where the image data is supp.ied by being ^Z^ ressed in such a manner that the 

[0025] Further, for ^J^^^^S^^^t^ the leftmost position and a, the (y 

^i^xs" Pixels as described above, each o, x and y ^"^^^Z^^i^Ha* 
-gina^^^ 

(0, 0), (1,0)..-, (511,0), 
30 mVn\\*i\' i\ (511 f511 511} ie the order corresponding to the progressive scan. 

[0028 2 imlge da tafs wrWen to'he storage apparatus, an original image is supp.ied to the 

Llg prorressively scanned in synchronization with the clock. With this image data supply, honzontal address HA and 

the horizontal address HA and vertical address VA supplied to the address supply circuit 1. 

00301 The oixel-multiplied image forming circuit 3 is formed of pixel form.ng circuits 12a, 12b, 12c and 1 2d. Each 
[0030] .™P*~ ^"3s l2a 12b 12c and 1 2d is arranged to read out one or more pixels constituting an original 

Tom the pixels read out. and to respectively supply the formed pixels to the memories 1 3a, 1 3b, 1 3c, and 1 3d const, 

45 Z^^Co^^^Z^Z^, circuit 3 is formed of four pixe, forming circuits 1 2a to 1 2d for the reason 
described be.ow Th^f while one frame o. an origina. image is formed o. 512 x 512 pixels, one frame of a pixe.- 
descmjea ^'° w , Accordingly, if this relationship is simply considered, one pixel of an 

lorming circuits 12a to 1 2d for respectively forming four pixels. . 
[0032] It is assumed here that four pixels q(2x, 2y), q(2x + 1, 2y), q(2x, 2y + 1 . and q(2x 4 J 2y + 1) * a pixel 
multiplied image are related to one pixel p(x, y) o. an original image (tor example, ,n a case where refe r.ng^ to F»3. 
» . A, o. an'original image is an observed pixe,, a poce. of a pixe.^ultip.ied W ° ^ ^ 

55 adjacent pixels a 12 , a 13 , and a 1234 of the pixe.-multiplied image are formed , and that s ^ ^ cu s 1 2a tcfl2d 
(2x. 2y + 1 ), and q(2x + 1 . 2y + 1 ) of the pixel-multiplied image are generated in the pixel form.ng crcurts 1 2a to 1 20, 

[oS^l'he pixel-multiplied image memory 4 is formed of four memories 1 3a to 1 3d, as mentioned above. The mem- 
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ones 133 to 1 3d are arranged ^jf^^^ 

ro n o35] OU ?he operation ol thTs storage apparatus will ^ J^"^^ wrjting , the addresS supply circuit 1 directly 
0036 First, when image data is written, that ,s. the R/W i^v<M « ^ gupp|y 

luppL the input image memory 2 with it. The RMW circuit 5 writes .he 

circuit 1 . On the other hand, the RMW ^ f^^^^S^S 2 designated by horizontal addresses 
original image data in the memory cells (no I shown) of he input m g y ^ g ^ ^ q| an ong , na| 

p(0, 0), p(1. 0). ~, p(511, 0). 
p(0, 1), p(1. 1). P( 511 - 1 )' 

P( 5 11 ;'0). P ( 511 , 1), P(511, B11) are respectively stored in the input image memory 2 with addresses: 

(0, 0), (1,0), (511,0), 

(0, 1), (1, D: (511= 1): 

[003^^ 

Lnd q 2x + 1 , 2y + 1 ) forming a pixel-mutt,, 2d of £i pixel-muttiplied image forming circuit 3, 
«, the original image are ^^^SSSiS fSxifs q(2x, 2y), d(2x + 1 , 2y), q(2x. 2y + 1). and q (2x 
and the pixel forming c.rcurts 2a to 1 2d ^ es P^SiveTsuppS these pbcels to the memories 1 3a to 1 3d. 
+ 1 , 2y + 1) of the pixel-multiplied image and res pectively SW™ P jma ■ for examp ie. 

[0038 That is. the pixel of the pixe.-mu.tip.ied ^££££^*&* the ^ m9m °7 

r 0 o 3 r«^ 

mage. Accordingly, the pixel forming circuit 12b rea ds out P™'»£ ^ c|rcuit £ b tnen calculates the average 
-r^^dTa-ol™ 

JSSS Further, referring to Fig. 3. pixe, a. 3 ol the ^^C^ 
original image. Accordingly, the pixe. forming circuit (pixe ,s of the original image corre- 

A 3 in the input image memory 2 with storage of pixels "JJjJg^,^ 2c then calculates the average of 

p ^n-vrnic^r^ 

JSS Also, referring also to Fig. 3. pixe, a 1234 of the ^"gf* ^Z^^ ^ 

to the memory 13d as pixel q(2x + 1, 2y + 1) of the P^'T^'^^^'aupp.y circuit 1 . horizontal add»s. HAand 
[0042] On the other hand, in the delay circuits 11 a to " d ^^^"S'onningclreuhs 1 2a to 1 2d to generate 

P ?r":<~ image ' and are thereafter 

supplied to the memories 1 3a to 1 3d, respectively. and (2x + 1 . 2y + l) 

[0043] As a result, in the memories 1 ^1»PJ» * ^ ^^m/addriss (x, y). 

supplied from the pixel forming circuits 1 ^^*2J^2.L atM read ing. and when the selection flag des- 

Ksth^^^ 

s=? - - - - ~ - ut 

image memory 2 designated by horizontal address HP . anc "J^J ^ tne input jma ge memory 2 in the 

r004Sl One frame of the original image formed of 512 X 51 2 pixels is reaoo 
Lrve-descnbed manner, thus outputting the original image progressively scanned. 
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addtas. VA to it by ad<* amount, thai """'^™*T^3 li , aB „ ,„. m „mo,ias 13a to 1 3d. 

p,o 9 ....»e ao.n. and oatoot. in. d*i> *»•*•«' « ■** C^TTT d<2*. 2y . 1 ). and q(2x a 1 . 2y a 1 ) 
[00471 That ia. lit. m.mo.i.5 1 3. to 1 3d MX poclt q(2x »>• «f * ' ' * * 2y) ' q(2x , 2, » ,), and a(2x 

— -"a-";" 

memory 1 3a. , here iore each of the combinations (HA, VA) of horizontal address HA and 

ss a r.;. a s.d »y ksssss - — «— — - - m — 01 

the memories 1 3a to 13d. h pixe |. mu itipiied image stored in the 

[0051] If the original image and the p.xeMnult.pl.ed nr^taw J 8 ™ m ^ 6 r ^ pixels forming one frame of the 
lorming one frame of the pixel-muKiplied image •^^^S^tTrZS^ to make the delay circuits 

the address supply circuit 1 or RMW circuit 5. oarallel with an original image, the pixel- 

[0052] As described above, a pixel-multiplied image is formed and I in I para.ji 9 whefe 

multiplied image being formed by increasing the ™^\^^^* ™ ^l^xei-multiplied image 

ToSr^ shTsTstcond detailed arrangement for the storage apparatus sho^ in Fig. 1. In Fig. 6, portions 
Spondfng to those shown in Fig. 5 are indicated by the 

[0054] in this embodiment, an address supply circuit 1 is formed ' ^ h * jod and to there after 

[herein. The delay circuit 11 is arranged to delay addresses ^^^^^ZS^A image memory 4. 

rrn^r a = 

SKTSTt address supply circuit - arr^ to = ™-~^o^^ 
significant bit (additional address signal in the 2-brt «»un^ ^.^KJS significant bit of the horizontal address, 
HA supplied to the address supply circuit 1 , the added U^" 1 " J,e memory 22 through the delay circuit 11 . 

^ address VA' to an address terminal (AD) of the ^^^^^^^ image memory 2, 
[0055] in the embodiment shown in Fig. 6, therefore, when address £ y), s ; supplied to the npu g ^ ry 
the address supply circuit 1 supplies addresses (2x, 2y). (2x + 1 , 2y), (2x, 2y + 1 ). and (^x + ^ 

22 through the delay circuit 11 . ?2 descr jbed above, and the memory 22 

[0057] The pixel-multiplied image memory 4 is formed of one memory » " d «^ + sup )rom the delay 
is arranged to store, with addresses (2x, 2y), (2x + 1 2yK (2* 2y + 1), and px . T y ) PP^ ^ 
circu« 11 , pixels q(2x, 2y), q(2x + 1, 2y), q(2x, 2y + 1), and q(2x * A, 2y + 1 of a f xe, m p g 
pixel forming circuits 1 2a to 1 2d. Accordingly, the memory 22 has a capacity for storing 1 0^4 x : u p 

one frame of a pixel-multiplied image. H H, a e«> e .9y 2vl (2x + 1 2v) (2x 2y + 1 ). and (2x + 1 , 

[0058] The memory 22 is also arranged to read out, from addresses ( 2*2 y) j 2 x + 1. 2y). (2 •» < 
2y + 1 ) supplied from the delay circuit 11 , pixels q(2x, 2y), q(2x + 1 , 2y). q(2x. 2y + 1 ), and q(2x + , *y j 
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muttipiied image stored with these addresses, and to supply ft. ph* to RMW circuit 5. 

n^Uriemory 2 in'the same manner as in ^^XS^tX ♦ L 2V). 2y + 1). 

[0061] When the pixels ol the memory 2, the pixe, forming circuits 

and q(2x ♦ 1 . 2y + 1 ) forming a pixel-mul J s »°' ed ^ P nefate ^ (2x , 2y) , q(2x + , , 2y), q(2x, 2y 

IT- £^?^^ a * in the arran9ement showl in R9 ' 5 ' 

and sequentially supply these pixels to the memory 22. siqnjf icant bit or the most significant bit in the 

[0062] On the other hand, in the ^dress supply escort 1 he ^ ^ HA or V9rtical address V A supplied 
2-bit count value output from the counter 21 » £ ™£Zf™£% m o) tne horizonta l or vertical address. 
,o the address supply circuit 1 , the added brt tang se ^^S formed. That is, four addresses (2x, 2y). (2x 
1 0-bit horizontal address HA' and 10-b, ^^^^^ s Applied to the address supply circuit 1 as 
+ 1. 2y), (2x. 2y + 1), and (2x + 1. 2y ♦ 1) are J^^SSdiai VA These addresses (2x. 2y). (2x + 1 , 2y). (2x. 

are supplied to the memory 22. 1} and (2x + 1 ( 2y + 1) supplied 

,gn,,.a tM original «W •» »W* «~Q» • ^°?5^S^«3. outp oil.ori, U» HMW cta« 5. 
100651 Wri.ri ,oe o.boriori nag ^^"'^ToS address VA*. I .. .. odd™..- 1». W. 

the address terminals of the memory 22. supplied to the memory 

[0066] That is^when addresses (^2y). (2x ; + j 2^ 2x 2 + 1 and (2^ ^ ^ ^ ^ ^ ^ ^ g 
22, pixels q(2x, 2y), q(2x + 1 , 2y), q(2x 2y + 1 ), and q(<a + i , *y ' progre ssive scan, it is necessary 

(2x, 2y). q(2x ♦ 1 , 2y). q(2x, 2y + 1 ), and q 2x + 1 2y + + ^ jjj wjth a delay corresponding 

to supply, with respect to pixel q(2x. 2y) stored with address (2x, 2y), + 2) . lied „ is also 
,o one pixel (one pixel of the pixel-multiplied Jf*)^ ^ h t5S^oTth.^^M 
necessary to supply address (2x, 2y + 1) ^^^^^^^ ^r, it is necessary to supply 

SsV™^ 

in this embodiment) from the moment at ^"""^T^Kl 2y) (2x. 2y + 1), and (2x ♦ 1, 2y + 1) is 

looeB^ThT™ pixel-muftiplied image stored in the memory cells of the memory 
22 designated by addresses from the delay circuit 11 . (rom jxe| . 

to p.il.ol woo ao origM kagt. tn. pMWM ™» "^JST fma« " ^ Soaad l»r oaarop... io *M 
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claSS™ b,ocK mal b. lormed «o ,»y other *.p.. . 9 « . «PJ « • «•—. -■»• »» 

Salculatfon blocks each defined about observed original image data item as a unrt for calculat.ng predicted values 
ofpTxeMp xeU^s) constituting a pixe,mu,ti P ,ied image. That is, «. referring to Fig. a nine P-xe* n W 
O^cateX sympo. x in the J^)^ 

> J 5 soSre predated value calculation block about observed original image data item X, for ca.cu.at,on o. predated 
values of pixels Y.(1) to Y,(9). i.e., a block formed of 25 pixels: X (j . 2)(j . 2) , IWil'W ^ ^HW^W 
wX* W> Co,,. x u , 2) . X i(H) , X, X 1(M) , X i(J+2) . V t><r » Wv >W WiV W W> 

i£?££X£ STcSn of, for example, nine pixels Y 33 (1 ) to Y 33 (9) in a pixel-mumplied image su, 

P^Th^edicted'vS calculation b.ock obtained by the predicted value emulation block forming circuit 42 is 
suDDlied to the classification and adaptation processing circuit 43. H™ rf h-H 
[0080] The number o, pixels and the shape o, the predicted value calculation block are not hmited to hos des«nbed 
above as are the number of pixels and the shape of the classification block. However, it is des.rable that the number 
of piS.s torLg the predicted value calculation b.ock be greater than the number of pixels forming the classrfication 

rail in forming blocks in the above-described manner (also in processings other than the processing for taming 

is performed by assuming that the same pixels as those forming the frame edge exist outside the frame «JB* 
0082] The c assifica.ion and adaptation processing circuit 43 is formed of an adaptive dynamic range c*d,n ADRC) 

processing circuit, a classification circuit 45, a prediction coefficient ROM 46, and a predicts circu.t 47, and ,s arranged 

to perform classification and adaptation processing. ^i„ MM 0 ^ 

0083] Classification and adaptation processing is processing for classifying ,nput signals ^ 

cording to characters of the input signals and for performing adaptation processing su.table for each class, and consists 

mainly of classification processing and adaptation processing. 

[0084] Classification processing and adaptation processing will now be described briefly. 
[0085] Classification processing will first be described. 

0086 For example, as shown in Fig. 9A, an observed pixel and three pixels adjacent to the observed pKeT form a 
block of 2 x 2 pixels (classification block), and each pixel is expressed by one bit (having one of two levels of 0 and 
! n such a situation, there are 16 (= (2^) patterns for the block formed of four pixels in the 2 * ^™T^ 
the observed pixel with respect to distributions of the levels of the pixels, as shown in Fig. 9B. In this example, the 
obseteJ Tple^an be classified into one o, 1 6 patterns. Classification using such patterns is performed as classification 

^Tc^^^T^so be performed by considering the activity o, an image (image in a block) 

^r^o^T^Z Z^Se^ each of pixels form.ng an original image. Also, in this embod- 
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impnt a classification block formed of nine pixels in a 3 x 3array is used, as mentioned above. If classification process- 
nnT fi oerforme^ w t resect to such a classification block, an extremely larger number of classes. ,.e., are used. 
^TS^SSS. therefore, ADRC processing is performed in the ADRC processing circuH 4 
!o a classification block, such that the number of pixe.s forming the classification block ,. reduced, thereby reducing 

! h 009o7 b Tha 0 t iffoTe'ase of explanation, processing of a block formed of, for example, four pixe.s arranged aiong a 
ne as shot in Fig 10A. will be discussed. In ADRC processing of this block, the maximum MAX and the ™»n 
MIN of the pTxe, values are detected. Then, DR = MAX - MIN is set as a local byname range of the block, and the pixel 
value of each pixel constituting the block is requantized into K bits based on th,s dynamic range DR 
rSSl That f the minimum value MIN is subtracted from each pixel value in the block and the difference obtamed 
bv th s subtSc ion ts divided by DR/ 2 k The pixel value is converted into a code (ADRC code) corresponding to the 
luTofthtd^ 

^T^SZZZ range DR by 4 (=%). As shown in Fig. 10(B) th. pixel value is 

e q 00B 01 B 1 0B, or 11B (B benoting that the value is binary) if the dmded value belongs to .the doman lowest n 

fevel the domain second in evel from the lowest, the domain third in level from the lowest, or the domain highest ,n 

eve Decodrj of such a code is performed in such a manner that ADRC code 00B. 01 B, 10B, or 11 B ,s convened 

S^SSSZSZ. of the lowest level domain, the middle value L,, of the second .eve, domain, the middle 

L 10 of thTlhM level domain, or the middle va.ue L„ of the highest level ddmain, and the m,n,mum value M.N ,s added 

roo^lTuTADRc'processing is ca.led non-edge matching. Japanese Patent Laid-Open Publication K*™™ 
of the application made by the applicant of the present invention and other documents disc.ose details of such ADRC 

[0093] S ' r |f ADRC processing is performed for requantization with a number of bits sma.ler than! *>™>*~ 
assigned to each pixel constituting the block, the number of classes can be reduced as described above. Such ADRC 
processing is performed in the ADRC processing circuit 44. 

m094] In this embodiment, classification processing is performed in the classification crcuU 45 based on the ADRC 
code output from the ADRC processing circuit 44. Classification processing, however, may be performed to process 
daS f whS This undergone, lo'r example predictive coding (DPCM). block truncation coding (BTC), vector quantization 
(VQ), discrete cosine transform (DCT), Hadamard transform or the like. 
rn09Sl Adaptation processing will next be described. 

pSSq process £ be discussed in which, for example, a predicted va.ue Ely] of a pixel (pixel value) y o. an image 
corresponding to the above-mentioned pixel-multiplied image) is obtained by using a linear » 
scribed with a linear combination of predetermined prediction coefficients w„ w 2 , - and several pixels (pixel values) 
x 2 • constituting another image (an image having a smaller number of pixels) (an image °°n«W«*«»£ 
above-mentioned original image) obtained by thinning out the pixels of the above-ment.oned image (h^e-nafte referred 
fo as -leTrnlng data" as occasion bemanbs). In this case, the predicted value E[y] can be represented by the following 
equation: 



E[y] = w 1 x 1 



(1) 



45 



[0097] For generalization, a matrix W formed ol a set of prediction coefficients w. a matrix X formed of a set of learning 
data, and a matrix Y' formed of a set of prediction values E[y] are defined as follows. 



50 



X = 



55 
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W - 



w l' 




E[y,r 


w. 




Ely,] 




, Y* = 






E[y 3 ] 



10 



15 



20 



[0098] Then, the following observation equation is formed. 

XW = Y' 



(2) 

















y 2 


25 E - 




, Y = 






. e -. 




y n 



30 



, the following remainder equation is formed from equation (2). 

XW = Y + E 



(3) 



[0 100] in this case, the prediction coefficients Wj for obtaining predicted value E[y] close to the pixel value y of the 
entire image can be obtained by minimizing a square error: 



40 



mu™ es Tor obtains predated value Ely] Cose to pixel value y o, the ent.re .mage. 



9e, Be ? 



+ — m = 0(i - 1 - 2 -- n) 



(4) 



[01 02] Equation (3) is 



differentiated with respect to prediction coefficients to form the following equations: 
lfi_ x £fi- x ., ...,|?l=x jn ,(i = 1,2,..,m) 



(5) 



[01 03] Equations (6) are obtained from equations (4) and (5). 
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I e iXu = 0. ie lXi2 - 0. - Je^ - 0 

i - 1 1 ~ 1 



(6) 



i - 1 1 " 1 

• • • (7) 



25 



3a 



J5 



S3 ^rr.s=^===s==s s 

dr ess^s coTresponding to the Cass information (the set of prediction coefficients correspond^ to the Cass ,nforma 

S^^^iSTIh^ coefficient BOM 46, thereby obtaining predicted values of 3 x 3 p,xe.s of a 
ST U TJSitTo a nprocessin g differs from interpolation processing such as the above-described weighting addition 

S a "nd « .« "«g „*, l..=h« d.ta » » »n.bl. Ih. c<™po™n>s ccMM n <»— ™w ' » »• "P™*—- 

Sff^n^SSSSl and adaptation processing circuit 43, the classification block and the predicted value 
= JcuLion Ick are sunned to the ADRC processing section 44 and to tine adaptation process.ng court 46, respec 

lively. 
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[0113] Receiving the classification block, the ADRC processing circuit 44 processes the classification block by, for 
example, 1 -bit ADRC (ADRC for 1 -bit requantization) processing to covert (encode) the original image data into 1 -bit 
data, and outputs the encoded data to the classification circuit 45. In the classification circuit 45, the classification block 
processed by ADRC processing undergoes classification processing. That is, the state of level distribution of the pixels 
5 forming the classification block processed by ADRC processing is detected and the class to which the classification 
block belongs is determined. The result of this class determination is supplied as class information to the prediction 
coefficient ROM 46. 

[0114] In this embodiment, classification blocks each formed of nine pixels in a 3 X 3 array and processed by 1-bit 
ADRC processing undergo classification processing. Accordingly, each classification block is classified into one of 512 
10 (= (2 1 ) 9 ) classes. 

[01 1 5] When the prediction coefficient ROM 46 receives class information, it reads out a set of prediction coefficients 
corresponding to the class information from the sets of prediction coefficients stored with respect to classes, and sup- 
plies the read-out coefficients to the prediction circuit 47. In the prediction circuit 47, adaptation processing is performed 
by using the set of prediction coefficients from the prediction coefficient ROM 46 and the predicted value calculation 
is blockf rom the predicted value calculation block forming circuit 42, that is, calculation shown by equation (1 ) is performed 
to obtain predicted values of the pixels of a pixel-multiplied image. 

[01 1 6] Fig. 1 1 shows the configuration of an image processor which performs learning for obtaining sets of prediction 
coefficients stored in the prediction coefficient ROM 46 shown in Fig. 7. 

[0117] Learning image data (a learning pixel-multiplied image) for obtaining a set of prediction coefficients related 
20 to each class is supplied to a learning block forming circuit 91 and a teacher block forming circuit 92. 

[0118] The learning block forming circuit 91 extracts, for example, 5X5 pixels in the positional relationship indicated 
by symbols O in Fig. 8 (corresponding to pixels forming an original image) from the image data input to it , and supplies, 
as a learning block, the block formed of these 25 pixels to an ADRC processing 93 and to a learning data memory 96. 
[0119] In the teacher block forming circuit 92, a block formed of, for example, nine pixels in a 3 x 3 array is formed 
25 from the supplied image data. The block formed of nine pixels is supplied as a teacher block to a teacher data memory 
98. 

[01 20] In a case where in the learning block forming circuit 91 a block formed of 25 pixels in the positional relationship 
indicated by symbols O in Fig. 8, i.e., pixels X-,.,, X 12 , X 14 , X 15 , X 21 , X^ X 23 , X 24 , X 25 , X 31 , X 32 , X 33 , X 34 , X 35 , X^, 
X 42 , X 43 , X^, X 45 , X 51 , X 52 , X 53 , X^, and X^, is formed, a teacher block of 3 X 3 pixels surrounded by a square in 

30 Fig. 8 is formed in the teacher block forming circuit 92. 

[01 21] The ADRC processing circuit 93 extracts, for example, central nine pixels (3X3 pixels) from 25 pixels forming 
the learning block, and processes this block formed of nine pixels by 1-bit ADRC processing, as does the ADRC 
processing circuit 44 shown in Fig. 7. The block of 3 X 3 pixels processed by ADRC processing is supplied to the 
classification circuit 94. In the classification circuit 94, the block from the ADRC processing circuit 93 undergoes clas- 

35 sification processing, as does the block in the classification circuit 45 shown in Fig. 7. Class information thereby obtained 
is supplied to the learning data memory 96 and to the teacher data memory 98 via a terminal a of a switch 95. 
[01 22] In the learning data memory 96 or teacher data memory 98, the learning block from the learning block forming 
circuit 91 or the teacher block from the teacher block forming circuit 92 is stored with the address corresponding to the 
class information supplied to the memory. 

40 [01 23] In a case where in the learning data memory 96 a block formed of 5 x 5 pixels indicated by symbols O in Fig. 
S, i.e., pixels X 1V X 12 , X 14 , X 15 , X 21 , X 22 , X 23 , X 24 , X 25 , X 31 , X 32 , X33, X^, X 35 , X 41 , X 42 , X 43 , X 44 , X 45 , X 51 , X 52 , X 53 , 
X 54 , and X 55 , is stored as a learning block with a certain address, a block of 3 x 3 pixels surrounded by a square in 
Fig. 8 (indicated by symbols x in the figure) is stored as a teacher block in the teacher data memory 98 with the same 
address as that in the learning data memory 96. 

^5 [0124] The same processing is repeated with respect to all prepared learning images. Learning blocks and teacher 
blocks each formed ot nine pixels for enabling calculation of predicted values in the pixel-multiplied image forming 
circuit shown in Fig. 7 by using the predicted value calculation block formed of 25 original image data items having the 
same positional relationship with the 25 pixels forming the corresponding learning block are stored with the same 
addresses in the learning data memory 96 and the teacher data memory 98. 

50 [0125] The learning data memory 96 and teacher data memory 98 are arranged to store a plurality of information 
items with the same address, thereby enabling a plurality of leaning blocks and a plurality of teacher blocks to be stored 
with the same address. 

[01 26] After learning blocks and teacher blocks with respect toall the learning images have been stored in the learning 
data memory 96 and the teacher data memory 98, the switch 95, which has selected the terminal a, is changed to a 
55 terminal b to enable an output from a counter 97 to be supplied as an address to the learning data memory 96 and to 
the teacher data memory 98. The counter 97 counts a predetermined clock and outputs a count value. In the learning 
data memory 96 or the teacher data memory 98, the learning data block or teacher block corresponding to the count 
value is supplied to a calculation circuit 99. 
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[01 27] Accordingly, a set of learning blocks and a set of teacher blocks of the class corresponding to the count value 
of the counter 97 are supplied to the calculation circuit 99. 

[0128] When the calculation circuit 99 receives a set of learning blocks and a set of teacher blocks with respect to 
a certain class, it calculates, by the least squares method, a set of prediction coefficients which minimizes the error. 
[0129] That is, for example, if the pixel values of the pixels forming a learning block are x v x 2 , x 3 , and if prediction 
coefficients to be obtained are w v w 2 , w 3 , it is necessary for prediction coefficients w v w 2 , w 3> - to satisfy the 
following equation in order to obtain the pixel value y of one pixel constituting the teacher block by linear combination 
of these values. 

y = w 1 x l +w 2 x 2 +W3X3 + - 

[0130] In the calculation circuit 99, prediction coefficients w v w 2 , w 3 , which minimize the square error of the pre- 
dicted value w^ + w 2 x 2 + w 3 x 3 + »• from the true value y can be obtained from learning blocks of the same class and 
the corresponding teacher blocks by solving the normal equations'represented by equations (7) shown above. Accord- 
ingly, this processing may be performed with respect to classes to form sets of prediction coefficients related to the 
classes. 

[0131] The set of prediction coefficients obtained with respect to each class in the calculation circuit 99 is supplied 
to a memory 100. To the memory 100, the count value from the counter 97 is supplied as well as the set of prediction 
coefficients from the calculation circuit 99. In the memory 100, the set of prediction coefficients from the calculation 
circuit 99 is stored with addresses according to the count value from the counter 97. 

[0132] Thus, the set of prediction coefficients most suitable for predicting 3x3 pixels of the block of each class is 
stored in the memory 100 with the address corresponding to the class. 

[01 33) Sets of prediction coefficients stored in the memory 1 00 with respect to classes in the above-described manner 
are stored in the prediction coefficient ROM 46 shown in Fig. 7. 

[01 34] In this embodiment, a pixel-multiplied image in which the number of pixels in each of the horizontal and vertical 
directions is twice that of an original image is stored in the pixel-multiplied image memory 4. However, the number of 
pixels forming a pixel-multiplied image stored in the pixel-multiplied image memory 4 is not limited to this. 
[0135] A plurality of pixel-multiplied image memories 4 may be provided to store pixel-multiplied images having dif- 
ferent numbers of pixels each greater than that of an original image. 

[0136] In this embodiment, addresses obtained by processing horizontal address HA and vertical address VA sup- 
plied to the input image memory 2 are supplied to the pixel-multiplied image memory 4. Alternatively, the pixel-multiplied 
image memory 4 may be supplied with independent addresses prepared separately from horizontal address HA and 
vertical address VA supplied to the input image memory 2 to accessed. 

[0137] Also, in this embodiment, each of the input image memory 2 and the pixel-multiplied image memory 4 is 
accessed by being supplied with horizontal and vertical addresses respectively corresponding to horizontal and vertical 
positions of pixels forming an image. However, an address with respect to time, for example, may also be supplied to 
each of the input image memory 2 and the pixel-multiplied image memory 4. In such a case, a pixel-multiplied image 
is formed by using pixels of an original image distributed with time as well as pixels of the original image distributed in 
horizontal and vertical spatial directions. 

[0138] Further, it is not necessary for the input image memory 2 and the pixel-multiplied image memory 4 to be 
formed as memories physically separate from each other. These two memories may be combined into one memory. 
In such a case, a storage area of one memory may be assigned to each of the input image memory 2 and the pixel- 
multiplied image memory 4. 

[0139] In this embodiment ail of the address supply circuit 1 , the input image memory 2, the pixel-multiplied image 
forming circuit 3, the pixel-multiplied image memory 4, and the RMW circuit 5 are formed on one chip. However, it is 
not always necessary to form these components on one chip. 

[0140] In this embodiment, only a pixel-multiplied image obtained by increasing the number of pixels of an original 
image is formed. However, an image obtained by reducing the number of pixels of the original image may be formed 
and stored simultaneously with the pixel-multiplied image. 

[0141] The present invention can be applied to processing of an image scanned in a noninterlacing manner as well 
as to processing of an image scanned in an interlacing manner. 

[01 42] In this embodiment, the storage apparatus is realized in a hardware form. The storage apparatus of the present 
invention, however, may be realized by making a computer execute a program for performing the above-described 
processing. 

[0143] In the embodiment shown in Fig. 6, the pixel-multiplied image memory 4 is formed of one memory 22. Also 
in the arrangement shown in Fig. 6, the pixel-multiplied image memory 4 may be formed of four memories 1 3a to 1 3d ; 
as is that in the arrangement shown in Fig. 5. In such a case, the output of the counter 21 may be used as a signal for 
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selecting one of the four memories 13a to 13d, i.e., a kind of chip select signal, instead of being added as the least 
sionificant bit ot horizontal address HA and vertical address VA. , ra „ H „ m 
roW in this embodiment pixels (pixel values) are stored in, for example, a memory represented by a RAM (random 
Lccttl memo" oMheTe. Alternative*, pixels may be stored (recorded) on a recording medium, e.g., a magnetic 

sa; TK^^i^^M^ — • - r e : s,ore r in : 

means in which addresses are designated by at least first and second address s.gnals, and a pixel-multiplied -mage 
which i an image formed of a number of pixels greater than the number of pixels forming the .put 
Uom thelnput image, the pixel-multiplied image being stored in a second storage means in wh.ch **™«"" 
donated by at least first and second address signals. Consequently, it is possible to immed.ately prov.de an ,mage 

SET ^^^^^os^s of the above disclosure concede *» 
scope of the invention, and the gist of the present invention is not limited to the above-described embodiments. 



Claims 

1. A storage apparatus for storing an image, comprising: 
20 a first memory section having addresses designated therein by at least first and second address signals to 

a7ormTngTe U ct!onfo e r' forming, from the input image, a pixel-multiplied image which is an image formed of a 
number of pixels greater than the number of pixels forming the input image; and . olnn «„ 
a second memory section having addresses designated therein by at least the f.rst and second address s.gnals 
25 to store the pixel-muttiplied image. 

2 A storage apparatus according to Claim 1 , wherein said second memory section addresses stored therein by 
at least the first and second address signals and by an additional address s.gnal added to the first and second 
address signals. 

A storage apparatus according to Claim 1 , wherein said forming section forms a pixel constituting the pixel-multi- 
plied image by performing weighting addition using a plurality of pixels in the pixels forming the input .mage. 

A storage apparatus according to Claim 1 , wherein said forming section forms the pixel-muttiplied image by using 
prediction coefficients for calculating a predicted value of a pixel constituting the pixel-multiplied image by linear 
combination with some of the pixels forming the input image. 

5. A storage method comprising the steps of: 

40 making a first memory section store an input image, the first memory section having addresses designated 

therein by at least first and second address signals; 

forming, from the input image, a pixel-multiplied image which is an image formed of a number of pixels greater 
than the number of pixels forming the input image; and 

making a second memory section store the pixel-multiplied image, the second memory section having ad- 
45 dresses designated therein by at least the first and second address signals. 

6 A storage method according to Claim 5, wherein, in said storage step using the second memory section, the second 
memory section has addresses stored therein by at least the first and second address signals and by an additional 
address signal added to the first and second address signals. 



30 



35 



50 



55 



7 A storage method according to Claim 5, wherein, in said forming step, a pixel constituting the pixel-multiplied image 
is formed by performing weighting addition using a plurality of pixels in the pixels forming the input image. 

8 A storage method according to Claim 5, wherein, in said forming step, the pixel-multiplied image is formed by using 
prediction coefficients for calculating a predicted value of a pixel constituting the pixel-multiplied image by linear 
combination with some of the pixels forming the input image. 
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FIG. 3 



A1 



A2 
ai2 i 

ai3 — * f A4 

_yO\C>^0 



A3 



ai234 

o o o 



o 
o 
o 
o 
o 
o 



o 
o 
o 
o 
o 
o 



o 
o 
o 
o 
o 
o 



o 

o 

o 

o 

o 

o 

o 

o 

o 



o 

o 

o 

o 

o 

o 

o 

o 

o 



c 
o 
o 
o 
o 
o 
o 
o 
o 



o 

o 

o 

o 

o 

o 

o 

o 

o 



o 

o 

o 

o 

o 

o 

o 

o 

o 



o 

o 

o 

o 

o 

o 

o 

o 

o 



o 

o 

o 

o 

o 

o 

o 

o 

o 



o 

o 

o 

o 

o 

o 

o 

o 

o 



o 

o 

o 

o 

o 

o 

o 

o 

o 



o 
o 
o 
o 
o 
o 
o 
o 
o 



o 

o 

o 

o 

o 

o 

o 

o 

o 



o 
o 
o 
o 
o 
o 
o 
o 
o 



o 

o 

o 

o 

o 

o 

o 

o 

o 



512 

PIXELS 



oooooooooooooo- 
ooooooooooo"ooo- 

^ _ 



512 PIXELS 



o o 
o o 



17 



EP0 895 188 A2 



FIG. 4 
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FIG. 8 
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FIG. 10A 
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